Skip to content

docs: Remove numpy from auto-excluded build packages#581

Merged
muhsinking merged 2 commits intomainfrom
promptless/flash-numpy-build-exclusion
Mar 23, 2026
Merged

docs: Remove numpy from auto-excluded build packages#581
muhsinking merged 2 commits intomainfrom
promptless/flash-numpy-build-exclusion

Conversation

@promptless
Copy link
Contributor

@promptless promptless bot commented Mar 23, 2026

Open this suggestion in Promptless to view citations and reasoning process

Updates the flash build docs to remove numpy from the auto-excluded packages list. NumPy was incorrectly being stripped from CPU endpoint builds because CPU base images (python-slim) don't ship it pre-installed. Now clarifies that only CUDA/GPU packages (torch, torchvision, torchaudio, triton) are auto-excluded.

Trigger Events

runpod/flash PR #263: fix(build): remove numpy from dependency blacklist, rename to SIZE_PROHIBITIVE_PACKAGES

Promptless Research (6 files, 1 GitHub PR)

  • Reviewed runpod/flash#263
  • Viewed .long_term_context/product_knowledge/product_overview.md
  • Viewed .long_term_context/doc_workflow/client_instructions.md
  • Viewed flash/cli/build.mdx
  • Viewed flash/apps/build-app.mdx
  • Viewed flash/troubleshooting.mdx
  • Viewed .long_term_context/style/client_style_guide.md

Agent Response

I've created a documentation suggestion based on PR #263.

Summary

PR #263 renames BASE_IMAGE_PACKAGES to SIZE_PROHIBITIVE_PACKAGES and removes numpy from the auto-exclusion list. The root cause was that the blacklist was defined by what the GPU base image ships, not by actual size constraints. This was silently breaking CPU endpoints that declared numpy as a dependency (since CPU images use python-slim which doesn't have numpy pre-installed).

Documentation changes

I updated flash/cli/build.mdx to:

  1. Remove numpy from the auto-excluded packages list — Now only shows torch, torchvision, torchaudio, triton

  2. Updated the base image reference table — Removed numpy from both GPU and CPU rows

  3. Added a clarifying note — Explains that packages like numpy are not auto-excluded, and that CPU endpoints can include numpy in their dependencies

  4. Updated the troubleshooting section — Removed numpy from the "Archive is too large" error guidance

Suggestion URL: https://app.gopromptless.ai/suggestions/0710efec-63af-4d9a-bc1c-913f0cf45a5f


Tip: Request one-off documentation tasks in the Dashboard under New Task 🚀



<Tip>

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Citation: PR #263 renames BASE_IMAGE_PACKAGES to SIZE_PROHIBITIVE_PACKAGES and removes numpy from the list. The root cause was that the blacklist was defined by GPU base image contents, not size constraints, which silently broke CPU endpoints using python-slim that needed numpy. See changes in src/runpod_flash/cli/commands/build.py.
View source


- `torch`, `torchvision`, `torchaudio`
- `numpy`, `triton`
- `torch`, `torchvision`, `torchaudio`, `triton`
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Citation: Updated to match the new SIZE_PROHIBITIVE_PACKAGES constant in src/runpod_flash/cli/commands/build.py. Each package is annotated with its approximate size: torch (~500 MB), torchvision (~50 MB), torchaudio (~30 MB), triton (~150 MB).
View source

@muhsinking muhsinking self-requested a review March 23, 2026 17:17
@promptless
Copy link
Contributor Author

promptless bot commented Mar 23, 2026

Just a reminder: If you'd like me to act on any feedback you have via Github comments, just type @Promptless in your suggestion and I'll get right on it! (I won't show up in the user dropdown, but I'll process any request that has @Promptless in the comment body.)

@muhsinking muhsinking merged commit 77c6bde into main Mar 23, 2026
2 checks passed
@muhsinking muhsinking deleted the promptless/flash-numpy-build-exclusion branch March 23, 2026 17:23
@mintlify
Copy link

mintlify bot commented Mar 23, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
runpod-docs 🔴 Failed Mar 23, 2026, 5:30 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant